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In this set of four supplemental tables, we compare the baseline test scores of the treatment and 
matched control group samples observed in each year after KIPP entry (outcome years I to 4). As 
discussed in Chapter III, we used an iterative propensity score estimation procedure to calculate 
each student’s probability of entering KIPP in fifth or sixth grade, and then applied nearest-neighbor 
matching (without replacement) to identify a matched comparison group of students similar to 
KIPP students in terms of observed demographic characteristics and prior achievement at baseline. 
In that chapter, we also showed that the mean baseline math and reading scores of KIPP students in 
each of the 22 schools are not significantly different from their matched comparison students at the 
five percent level (see Table III.l). 

The matching process included all fifth and sixth grade student cohorts with at least one year of 
outcome data. The analytic sample size decreases in subsequent outcome years for two main 
reasons: first, more recent student cohorts had fewer years of available outcome data than earlier 
cohorts, so fewer cohorts are included. Second, within a given cohort, we also observe sample 
attrition at the student level as students transfer out of the jurisdiction or otherwise drop out of the 
dataset. As a result, impact estimates beyond the first year after KIPP entry did not include all of the 
treatment and matched comparison students measured in Table III.l. To investigate whether the 
treatment and control groups maintain baseline equivalence in all four years, the following tables 
expand on Table III.l by repeating the comparison of baseline test scores for the portion of the 
initial sample that was included in each year’s impact estimate. The tables also include treatment and 
control sample sizes for each school and year. 

For each matched sample used for the four estimate years, the tables show that the mean 
baseline math and reading scores of KIPP students, in all 22 schools, are not significantly different 
from the scores of matched comparison students at the five percent level. While sample sizes decline 
in each successive year after KIPP entry, the baseline achievement of treatment and matched 
comparison students remain similar for all four impact estimate years included in the study’s 
benchmark results. 



* These tables provide additional supplementary materials for the following report: Tuttle, Christina Clark, 
Bing-ru Teh, Ira Nichols-Barrer, Brian Gill, and Philip Gleason. “Student Characteristics and Achievement in 22 
KIPP Middle Schools.” Washington, DC: Mathematica Policy Research, June 2010 < http://www.mathematica- 
mpr.com/publications/pdfs/education/KIPP fnlrpt.pdf >. 



Table S.1. Balance Between KIPP Students and Matched Comparison Students in Year One 



Baseline Reading Score Baseline Math Score Sample Size 



School 


KIPP 

(1) 


Comparison 

(2) 


KIPP 

(3) 


Comparison 

(4) 


KIPP 

(5) 


Comparison 

(6) 


School A 


-.62 


-.69 


-.70 


-.81 


349 


339 




(.04) 


(.04) 


(.04) 


(.04) 






School B 


-.42 


-.41 


-.39 


-.35 


379 


356 




(.04) 


(.05) 


(.04) 


(.04) 






School C 


- .41 


-.45 


-.45 


-.46 


365 


368 




(.04) 


(.04) 


(.04) 


(.04) 






School D 


-.40 


-.35 


-.52 


-.49 


122 


113 




(.09) 


(.10) 


(.08) 


(.08) 






School E 


-.32 


-.41 


-.51 


-.58 


150 


149 




(.08) 


(.08) 


(.07) 


(.08) 






School F 


-.25 


-.18 


-.19 


-.14 


235 


225 




(.06) 


(.05) 


(.05) 


(.05) 






School G 


- .17 


-.13 


-.24 


-.22 


101 


119 




(.08) 


(.09) 


(.08) 


(.08) 






School H 


- .17 


-.15 


-.09 


-.11 


198 


197 




(.05) 


(.05) 


(.05) 


(.05) 






School 1 


-.09 


-.11 


- .14 


-.12 


263 


277 




(.04) 


(.04) 


(.04) 


(.04) 






School J 


-.09 


-.10 


-.05 


-.07 


337 


339 




(.04) 


(.04) 


(.04) 


(.04) 






School K 


-.08 


-.11 


-.08 


-.13 


364 


365 




(.04) 


(.04) 


(.04) 


(.05) 






School L 


-.01 


.02 


.07 


.16 


279 


286 




(.05) 


(.05) 


(.04) 


(.04) 






School M 


.00 


.06 


.02 


.07 


158 


171 




(.07) 


(.07) 


(.07) 


(.06) 






School N 


.01 


.00 


-.01 


.00 


340 


329 




(.05) 


(.05) 


(.05) 


(.04) 






School 0 


.03 


-.01 


- .11 


-.15 


198 


208 




(.06) 


(.06) 


(.06) 


(.06) 






School P 


.06 


.04 


.10 


.10 


223 


225 




(.06) 


(.06) 


(.05) 


(.06) 






School Q 


.07 


-.02 


-.05 


-.09 


232 


210 




(.05) 


(.05) 


(.06) 


(.06) 






School R 


.14 


.20 


.30 


.31 


398 


385 




(.04) 


(.04) 


(.04) 


(.05) 






School S 


.19 


.21 


.19 


.25 


244 


257 




(.05) 


(.05) 


(.05) 


(.05) 






School T 


.21 


.22 


.02 


.00 


155 


152 




(.07) 


(.07) 


(.07) 


(.07) 






School U 


.21 


.17 


.19 


.14 


249 


283 




(.05) 


(.05) 


(.05) 


(.05) 






School V 


.29 


.25 


.24 


.31 


275 


275 




(.05) 


(.05) 


(.05) 


(.05) 







Note: Standard errors reported in parentheses. 

* Statistically significant at the five percent level 
** Statistically significant at the one percent level 
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Table S.2. Balance Between KIPP Students and Matched Comparison Students in Year Two 



Baseline Reading Score Baseline Math Score Sample Size 



School 


KIPP 

(1) 


Comparison 

(2) 


KIPP 

(3) 


Comparison 

(4) 


KIPP 

(5) 


Comparison 

(6) 


School A 


-.63 


-.65 


- .71 


-.76 


256 


223 




(.05) 


(.05) 


(.05) 


(.05) 






School E 


-.45 


-.50 


-.53 


-.68 


98 


93 




(.10) 


(.10) 


(.09) 


(.11) 






School C 


-.40 


-.43 


-.45 


-.43 


282 


272 




(.04) 


(.04) 


(.05) 


(.05) 






School B 


-.39 


-.39 


-.37 


-.30 


268 


234 




(.06) 


(.06) 


(.05) 


(.05) 






School D 


-.38 


-.28 


-.51 


-.45 


101 


98 




(.09) 


(.10) 


(.08) 


(.08) 






School G 


-.29 


- .17 


-.37 


-.26 


76 


94 




(.11) 


(.11) 


(.10) 


(.09) 






School F 


-.26 


-.18 


-.23 


-.16 


204 


190 




(.07) 


(.06) 


(.06) 


(.06) 






School H 


-.19 


- .17 


-.04 


- .11 


137 


136 




(.06) 


(.05) 


(.06) 


(.06) 






School 0 


- .11 


-.13 


-.13 


-.35 


101 


106 




(.09) 


(.09) 


(.08) 


(.09) 






School 1 


-.08 


-.16 


-.10 


- .14 


170 


184 




(.06) 


(.06) 


(.05) 


(.05) 






School J 


-.07 


- .11 


-.01 


-.05 


278 


261 




(.04) 


(.04) 


(.04) 


(.04) 






School M 


-.04 


.03 


.06 


.07 


92 


105 




(.10) 


(.09) 


(.10) 


(.08) 






School K 


-.04 


-.06 


-.08 


-.07 


263 


265 




(.05) 


(.05) 


(.05) 


(.05) 






School L 


.00 


.05 


.11 


.16 


209 


229 




(.06) 


(.05) 


(.05) 


(.04) 






School N 


.00 


.02 


-.05 


.04 


260 


248 




(.05) 


(.05) 


(.05) 


(.05) 






School Q 


.05 


-.03 


-.01 


-.05 


163 


137 




(.06) 


(.07) 


(.06) 


(.08) 






School P 


.13 


.12 


.10 


.10 


155 


159 




(.06) 


(.07) 


(.05) 


(.06) 






School T 


.14 


.15 


-.06 


-.09 


106 


100 




(.08) 


(.09) 


(.09) 


(.10) 






School U 


.16 


.15 


.19 


.12 


193 


153 




(.06) 


(.07) 


(.06) 


(.06) 






School R 


.23 


.22 


.36 


.24 


296 


236 




(.05) 


(.06) 


(.05) 


(.06) 






School S 


.25 


.27 


.26 


.33 


192 


196 




(.04) 


(.05) 


(.05) 


(.05) 






School V 


.26 


.19 


.25 


.31 


204 


196 




(.06) 


(.07) 


(.06) 


(.06) 







Note: Standard errors reported in parentheses. 

* Statistically significant at the five percent level 
** Statistically significant at the one percent level 



S-3 



Table S.3. Balance Between KIPP Students and Matched Comparison Students in Year Three 



Baseline Reading Score Baseline Math Score Sample Size 



School 


KIPP 

(1) 


Comparison 

(2) 


KIPP 

(3) 


Comparison 

(4) 


KIPP 

(5) 


Comparison 

(6) 


School A 


-.67 


-.65 


-.76 


-.73 


179 


162 




(.05) 


(.05) 


(.05) 


(.06) 






School C 


-.42 


-.42 


- .47 


-.42 


190 


191 




(.06) 


(.05) 


(.06) 


(.05) 






School E 


-.42 


-.46 


-.39 


-.55 


35 


40 




(.16) 


(.15) 


(.18) 


(.15) 






School B 


-.40 


-.36 


-.33 


-.27 


179 


159 




(.07) 


(.07) 


(.06) 


(.07) 






School D 


-.35 


-.28 


-.59 


- .47 


105 


93 




(.09) 


(.10) 


(.08) 


(.08) 






School F 


-.31 


-.19 


-.28 


- .17 


129 


125 




(.09) 


(.08) 


(.08) 


(.08) 






School G 


-.24 


-.19 


- .41 


-.28 


70 


75 




(.12) 


(.13) 


(.11) 


(.10) 






School H 


-.12 


-.13 


.06 


-.04 


73 


72 




(.06) 


(.07) 


(.08) 


(.08) 






School 1 


-.09 


-.13 


-.05 


-.16 


106 


131 




(.07) 


(.06) 


(.06) 


(.06) 






School 0 


-.04 


-.16 


-.06 


-.34 


64 


46 




(.12) 


(.14) 


(.10) 


(.13) 






School L 


-.04 


.00 


.08 


.10 


140 


160 




(.07) 


(.06) 


(.06) 


(.06) 






School K 


-.03 


-.04 


-.05 


-.02 


182 


183 




(.06) 


(.06) 


(.06) 


(.06) 






School J 


-.03 


-.06 


-.01 


-.03 


209 


198 




(.05) 


(.05) 


(.05) 


(.05) 






School M 


.07 


.23 


.22 


.27 


50 


61 




(.12) 


(.09) 


(.12) 


(.08) 






School U 


.08 


.16 


.10 


.19 


123 


101 




(.08) 


(.08) 


(.07) 


(.09) 






School N 


.10 


.08 


.00 


.04 


183 


185 




(.06) 


(.06) 


(.06) 


(.06) 






School Q 


.10 


-.02 


.03 


-.02 


84 


81 




(.07) 


(.09) 


(.08) 


(.09) 






School P 


.14 


.13 


.11 


.08 


111 


106 




(.07) 


(.08) 


(.07) 


(.08) 






School R 


.22 


.17 


.38 


.24 


210 


205 




(.06) 


(.07) 


(.06) 


(.07) 






School S 


.26 


.28 


.24 


.25 


133 


141 




(.05) 


(.06) 


(.07) 


(.07) 






School V 


.27 


.17 


.23 


.30 


142 


133 




(.07) 


(.08) 


(.07) 


(.07) 






School T 


.27 


.21 


.00 


-.02 


48 


46 




(.11) 


(.13) 


(.12) 


(.15) 







Note: Standard errors reported in parentheses. 

* Statistically significant at the five percent level 
** Statistically significant at the one percent level 
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Table S.4. Balance Between KIPP Students and Matched Comparison Students in Year Four 



School 


Baseline Reading Score 


Baseline Math Score 


Sample Size 


KIPP 

(1) 


Comparison 

(2) 


KIPP 

(3) 


Comparison 

(4) 


KIPP 

(5) 


Comparison 

(6) 


School A 


-.72 


-.65 


-.77 


-.76 


105 


91 




(.07) 


(.07) 


(.08) 


(.09) 






School B 


-.63 


-.42 


-.54 


-.28 


88 


75 




(.09) 


(.09) 


(.09) 


(.10) 






School C 


- .47 


-.40 


-.58 


-.39 


103 


103 




(.07) 


(.08) 


(.07) 


(.08) 






School F 


-.34 


-.21 


-.25 


- .14 


59 


49 




(.14) 


(.13) 


(.12) 


(.12) 






School 1 


-.29 


-.34 


-.31 


-.36 


33 


38 




(.14) 


(.15) 


(.15) 


(.12) 






School D 


-.27 


-.28 


-.37 


- .44 


42 


51 




(.11) 


(.11) 


(.10) 


(.09) 






School L 


-.24 


-.10 


-.03 


.05 


75 


75 




(.09) 


(.09) 


(.08) 


(.08) 






School G 


-.19 


-.18 


-.36 


-.30 


36 


36 




(.15) 


(.16) 


(.16) 


(.15) 






School K 


-.09 


-.03 


-.08 


-.07 


114 


114 




(.08) 


(.08) 


(.08) 


(.09) 






School J 


-.07 


-.15 


-.01 


-.05 


125 


113 




(.06) 


(.06) 


(.06) 


(.06) 






School N 


.00 


.06 


-.06 


.06 


94 


91 




(.09) 


(.08) 


(.08) 


(.08) 






School U 


.11 


.17 


.04 


.17 


46 


42 




(.13) 


(.12) 


(.11) 


(.11) 






School M 


.12 


.20 


.22 


.22 


36 


47 




(.14) 


(.09) 


(.17) 


(.10) 






School S 


.17 


.14 


.14 


.10 


79 


81 




(.06) 


(.06) 


(.07) 


(.07) 






School R 


.19 


.13 


.30 


.19 


132 


130 




(.08) 


(.09) 


(.09) 


(.09) 






School P 


.19 


.00 


.09 


.08 


46 


49 




(.09) 


(.12) 


(.08) 


(.12) 






School V 


.22 


.13 


.17 


.21 


90 


88 




(.10) 


(.10) 


(.08) 


(.08) 






School E 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


School H 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


School 0 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


School Q 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


School T 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 



Note: Standard errors reported in parentheses. 

* Statistically significant at the five percent level 
** Statistically significant at the one percent level 
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